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CLAIMS 

What is claimed is: 

1. An automatic image cropping system for use with a portable 
device having an image capture mechanism and a limited resource for storing 

5 or transmitting captured information, the system comprising a region of 
interest suggestion engine defining plural image region candidates by 
performing image segmentation on an image stored in digital form, 
determining if an image region candidate is likely to be more or less 
interesting to a user than another image region candidate, and selecting an 
10 image region candidate determined as likely to be of most interest to the user. 

2. The system of claim 1, wherein said region of interest 
suggestion engine measures entropies of the image region candidates and 
uses entropy thus measured as a measure of likelihood of user interest. 

3. The system of claim 2, wherein said region of interest 
1 5 suggestion engine computes a cost C according to: 

c = * + ^ +r( L*^ + UlzL4 

H H +H U +H V /U, w h 

where h lt t H ut H v are entropies of sub-images H, U and V respectively, 
_ Area^ is an area ratio of an image region candidate and a common 

viewing area of the image, x e ,Y e is a center of the image region candidate, 
20 '«/J s a center of the common viewing area of the image, w ,h are width and 
height of a lens viewing area, and a, (3, y are normalizing weights. 

4. The system of claim 3, wherein said region of interest 
suggestion engine initializes parameters a, p, y to empirically normalize and 
balance all three components that contribute to the cost: entropy (E), area 

25 ratio (A) and center distance (D), generates lists of the image region 
candidates according to E, A, D and their total cost: ocE + pA + yD, suggests 
the image region candidates by making them available for viewing and 
selection, analyzes components E, A, D on an image region candidate 
selected by the user, and adjusts parameters a, p, y accordingly. 

30 5. The system of claim 3, wherein said region of interest 

suggestion engine deems an image region candidate having a lowest cost C 
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thus computed as likely to be of greatest interest to the user relative to other 
image region candidates. 

6. The system of claim 3, wherein parameters a, (}, y are selected 
based on characteristics of an image capture device. 
5 7. The system of claim 3, wherein parameters a, p, y are selected 

based on habits of the user. 

8. The system of claim 2, wherein said region of interest 
suggestion engine measures entropy of an image region candidate according 
to: 

10 =-£/i(i)log 2 A!(i) 

i 

where h(i) ie / is a histogram of the image region candidate. 

9. The system of claim 1, wherein said region of interest 
suggestion engine segments the image based on image texture and color 
consistency. 

15 10. The system of claim 9, wherein said region of interest 

suggestion engine uses vectors calculated from Wavelet transform to 
represent texture information. 

11. The system of claim 1, wherein said region of interest 
suggestion engine employs a fuzzy k-mean clustering method to perform the 

20 image segmentation. 

12. The system of claim 11, wherein said region of interest 
suggestion engine uses features in the clustering method derived on color 
differences of neighboring pixels / and j defined according to: 

c JiJf 0, j) = Vwo- wlr? +Mi)-uu)f +(v(o-vo» 2 
25 where h(i), u(i) and v(i) are an HUV value of pixels / and h(j), u(j) and v(j) are 
an HUV value of pixel /. 

13. The system of claim 1, wherein said region of interest 
suggestion engine performs color transformation on an image stored in digital 
form. 

30 14. The system of claim 13, wherein said region of interest 

suggestion engine transforms an image in RGB format into HUV (Hue, 
Saturation and Intensity) format. 
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15. The system of claim 1, wherein said region of interest 
suggestion engine measures sizes of image region candidates relative to a 
common viewing area of the image and uses relative size thus measured as a 
measure of likelihood of user interest. 
5 16. The system of claim 1, wherein said region of interest 

suggestion engine measures locations of image region candidates relative to 
a common viewing area of the image and uses relative location thus 
measured as a measure of likelihood of user interest. 

17. The system of claim 1, wherein said region of interest 
10 suggestion engine pre-processes the image to eliminate noise in blurred text 

histograms to smooth the image. 

18. The system of claim 1, further comprising a graphic user 
interface initially giving a focus to the image region candidate selected by said 
region of interest suggestion engine, displaying an image region candidate 

15 having the focus with a first display property visually distinguishable from a 
second display property employed to simultaneously display image region 
candidates not having the focus, shifting focus between displayed image 
region candidates in response to user navigation selections, and excluding 
image contents outside an image region candidate having the focus in 

20 response to user confirmation of the image region candidate having the focus. 

19. The system of claim 18, wherein said image region suggestion 
engine ranks image region candidates according to likelihood of user interest, 
and said graphic user interface shifts the focus between image region 
candidates based on ranking of the image region candidates. 

25 20. The system of claim 1 , wherein the engine further comprises a 

training module to track user interaction with the portable device and adjust 
future determination of likelihood of user interest accordingly. 

21 . The system of claim 1 , wherein said engine uses camera sensor 
data to determine likelihood of user interest. 
30 22. An automatic image cropping method, comprising: 

performing image segmentation on an image stored in digital 
form, thereby defining plural image region candidates; 
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determining if an image region candidate is likely to be more or 
less interesting to a user than another image region candidate; and 

selecting an image region candidate determined as likely to be 
of most interest to the user. 
5 23. The method of claim 22, further comprising measuring entropies 

of the image region candidates and using entropy thus measured as a 
measure of likelihood of user interest. 

24. The method of claim 23, further comprising computing a cost C 
according to: 

H H +H V +H V A^ w h 

where h„m u m v are entropies of sub-images H, U and V respectively, 
_ Area ROl is an area ratio of an image region candidate and a common 

viewing area of the image, x c ,y c is a center of the image region candidate, 
/^/Js a center of the common viewing area of the image, w ,h are width and 

15 height of a lens viewing area, and a, p, y are normalizing weights. 

25. The method of claim 24, further comprising: 

initializing parameters a, p, y to empirically normalize and 
balance all three components that contribute to the cost: entropy (E), area 
ratio (A) and center distance (D); 
20 generating lists of the image region candidates according to E, 

A, D and their total cost: aE + PA + yD\ 

suggesting the image region candidates by making them 
available for viewing and selection; and 

analyzing components E, A, D on an image region candidate 
25 selected by the user and adjusting parameters a, p, y accordingly. 

26. The method of claim 24, further comprising deeming an image 
region candidate having a lowest cost C thus computed as likely to be of 
greatest interest to the user relative to other image region candidates. 

27. The method of claim 24, further comprising selecting parameters 
30 a, P, y based on characteristics of an image capture device. 
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28. The method of claim 24, further comprising selecting parameters 
a, p, y based on habits of the user. 

29. The method of claim 23, further comprising measuring entropy 
of an image region candidate according to: 

5 » aa -5><0k* 1 «i> 

i 

where h(i) i e / is a histogram of the image region candidate. 

30. The method of claim 22, further comprising suggesting the 
selected image region candidate to a user. 

31. The method of claim 30, further comprising receiving a user 
10 confirmation of the selected image region candidate. 

32. The method of claim 31, further comprising processing the 
image based on the user confirmation. 

33. The method of claim 31, further comprising segregating the 
selected image region candidate from at least one other part of the image in 

1 5 response to receipt of the user confirmation. 

34. The method of claim 31, further comprising saving the selected 
image region candidate absent image contents external to the selected image 
region in response to receipt of the user confirmation. 

35. The method of claim 31, further comprising transmitting the 
20 selected image region candidate absent image contents external to the 

selected image region in response to receipt of the user confirmation. 

36. The method of claim 31, further comprising zooming in on the 
image region candidate in response to receipt of the user confirmation. 

37. The method of claim 30, further comprising: 

25 receiving a user contradiction of the selected image region 

candidate; and 

selecting a new image region candidate determined as most 
likely to be of most interest to the user based on the user contradiction. 

38. The method of claim 22, further comprising segmenting the 
30 image based on image texture and color consistency. 

39. The method of claim 38, further comprising using vectors 
calculated from Wavelet transform to represent texture information. 
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4U. i ne metnod ot claim 22, further comprising employing a fuzzy k- 
mean clustering method to perform the image segmentation. 

41 . The method of claim 40, further comprising using features in the 
clustering method derived on color differences of neighboring pixels / and j 

5 defined according to: 

<W V»J) = V<A(0-(AU» a + («0)-«U)) 2 +(v(/)-v(y)) 2 

where h(i), u(i) and v(i) are an HUV value of pixels / and h(j), u(j) and v(j) are 
an HUV value of pixel / 

42. The method of claim 22, further comprising performing color 
1 0 transformation on an image stored in digital form. 

43. The method of claim 42, further comprising transforming an 
image in RGB format into HUV (Hue, Saturation and Intensity) format. 

44. The method of claim 22, further comprising measuring sizes of 
image region candidates relative to a common viewing area of the image and 

15 using relative size thus measured as a measure of likelihood of user interest. 

45. The method of claim 22, further comprising measuring locations 
of image region candidates relative to. a common viewing area of the image 
and using relative location thus measured as a measure of likelihood of user 
interest. 

20 46. The method of claim 22, further comprising capturing an image 

in digital form. 

47. The method of claim 22, further comprising pre-processing the 
image to eliminate noise in blurred text histograms to smooth the image. 

48. The method of claim 22, further comprising tracking user 
25 interaction with the portable device and adjusting future determination of 

likelihood of user interest accordingly. 

49. The method of claim 22, further comprising using camera sensor 
data to determine likelihood of user interest. 
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